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(57) Abstract 

An interactive andio^yisual 
(A/V) ttsmsccivtr is advantageously 
led to a television and/or 

rJKWW cable, a TV, a video 

recoider (VCR), and other A/V 
devices. TTje A/V transceiver switdtes 
between a program/service 
der and the connected A/V 
devices. In one embodiment, the 



CPU, a system bus. system memory, 
an infia-red (IR) control uiut, an 
audio-visual bus, an A/V decoder, an 
A/V processor, and an A/V encoder, 
an A/V connect module including 
a number of nuier/demodttlalon and 
a switch, and an optional CD ROM 
module. The A/V transceivex hardware 




"system "wS"sBti^m program wBai' 
snppots the functions provided in the 
A/V user inteiface. Additionally, a 
remote ctmirol device is provided to 
commnnicate with the A/V transceiver 
to '^'^I'^^l^^^,^'^^ ^ serrice offerings bam any selected sounx. viewing of selected program offerings. 

S'ta^'X^S^off^^S con^ol^^ce is advant^eously ^^1^ S^f^ ^tSsS 

S^HES^-bT^iS^^^^^aK^ 

a^ ^pointing device consisting of up, down, left, and right anow buttons, and a center select butmn. 
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METHODS AND APPARATUS FOR MANAGING SELECTION OF 
AUDIO-VISUAL PROGRAM AND SERVICE OFFERINGS 
RFT ATED A PPLICATIONS 



The present application is related to the following 
contemporaneously filed applications: 

(a) Serial No. ______ entitled "An Audio-Visual System 

For Selectively Viewing And Interacting With Programs And Services 
From A Nuriiber of Program/Service Sources"; 

(b) Serial No. , entitied "Method And Apparatus 

For Contirolling An Audio-Visual System For Selectively Viewing And 
Interacting With Programs And Services From A Number of 
Program/Service Sources"; 

(c) Serial No. , entitled "Methods And Apparatus 

For Managing Viewing Of And Interaction With Audio-Visual Program 
And Service Offerings". 
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BACKGROUND OF THE INVENTION 

1. Field of the Invention: 

The present invention relates to the field of audio-visual 
systems. More specifically, the present invention relates to a system for 
selectively viewing and interacting v^rith programs and services firom a 
number of program/service sources, a control device for controlling the 
system, and the methods and apparatus incorporated in the system for 
managing selection, viewing, and interacting with the program/ service 
offerings. 

2. Art Background: 

Over the past 40 years, television and rnotion pictures have 
become an important aspect of everyday life for people in the 
industrialized world. The development of advanced technology in the 
areas of digital and high defiiution television (HDTV), video recording 
systans, laser disks and compact disc (CD) entertainment systems, 
coupled with satellite, cable television and telephone services, have 
provided opportunities for viewers to store, retrieve and selectively 
display a variety of television and audio-visual or interactive 
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programming on home eiitertainment systems. Over the past decade, 
improvements in personal, computing systems have provided a variety 
of powerful miniaturized persorial computers which permit the storage 
of data and control of home appliances, such as entertainment systems, 
through the use of microprocessors.; Additionally, a variety of graphic 
user interfaces have been developed to ease human interaction with 
these new personal computer systems. 

The combination of computer technology with television 
(TV) and audio-visual (A/V) systems, has fostered the development of 
multi-media interactive entertainment systems. The combination of 
computer hardware and software with audio-visual systems has brought 
new forms of art and entertainment into being. CD read only memoiy 
(ROM) systems coupled to personal computers permit interactive video 
computer simulations, unique self-paced learning environments and 
interactive "movies", not possible in earUer television systems (See, 
"the Revolution Starts Here", Newsweek, page 42 Qanuary 18, 1993)). It 
is known that consumers desire interactive television and multi-media 
appUcations for home use. One of the biggest challenges for an 
interac^ve television service is the design of an interface that is easy and 
fun to use by average consumers. 
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In the computer indusby, a variety of graphic user 
interfaces have been developed to facilitate human interaction with 
computer systems. Many, display systems utilize metaphors in the design 
of the interface as a way of maximizing human familiarity, and 
conveying iriformation between the user and the computer. It is well 
known that designing arotmd a familiar metaphor helps reduce hvimah 
learning time (See for example, Patrick Chan, "Learning Consideratior\s 
In User Interface Design: Room Mo<ie/", Report CS-84-16, University 
of Waterloo Computer Science Department, Ontario, Canada, July, 1984, 
and the references cited therein). Research in interface design using 
metaphors in man-machine interfaces may be applied to multi-media 
systems, and in particular, to interactive television systems. 

The marriage of video arid television technology with 
computer interface technology provides consumers with maximum 
flexibility in storing, retrieving arid viewing television and other audio- 
visual progranuning. As will be described, tiie present invention 
provides methods and apparatus for presenting ait improved audio- 
visual user interface, which includes various user-selectable features for 
viewing and controlling a television, yidep tape recorder (VCR) and 
other audio-visual devicies. As will be disclosed, the present invention's 
user interface provides a user-friendly mechanism for consumers to 
view, record, and play back TV and A/V programs, as well as control 
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Other A/V home entertainment devices using a remote control device. 
Furthermore, information such as TV program Ustings and additional 
information related to programs as weU as selecting and controlling 
categories of interactive programs and services may be provided through 
the user interface of the present invention. 
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SUMMARY OF THE INVENTION 

The present invention provides methods and apparatiis for 
presenting an improved audio-visual user interface for selecting and 
displaying cable television or other audio-visiiaL programs, as well as 
controlling various audicHvisual devices and interactive services. . The 
present invention assumes a service provider provides cable television 
and/or telephone (T/T) service to users via a T/T cable, including a 
digital channel of program/service listings, at least one digital back 
charmel (from the user's home to a central file server), a nvunber of 
analog TV charmels, a number of digital pay-per-yiew channels, and 
other interactive services, transmitted from remote storage devices such 
as digital file servers. Under the present invention an interactive audio- 
visual (A/V) transceiver is advantageously coupled to a user's 
television, video tape recorder, and the T/T cable. In one embodiment, 
the transceiver includes three primary modules. A main module 
includes a central processing vmit (CPU) coupled over a digital system 
bus to system memory and, preferably, an infra-red (IR) or similar 
wireless control vmit. the main module is further coupled over an 
audio-visual bus to an A/V decoder, an A/V processor, an A/V encoder, 
a TV, an A/V connect module connected to the T/T cable, and to one or 
more VCRs and other A/V devices. The main module may also be 
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coupled to an optional CD ROM module, to permit the playback of 
multi-media CD ROM titles; audio CDs, and the like. Other optional 
modules or external devices (such as additional VCRs, CDs,-hard disks, 
telephone, fax and answering machines) may be cormected to this 
transceiver and contirolled through the use of the audio-visual user 
interface of the present invention. Th6 A/V traiwceiver hardware is 
complemented with an operating system software program which 
supports the fxmctions provided in the present invention's audio-visual 
user interface. 

In operation, the cable or telephone service provider 
transmits an interleaved data stieam preferably including a television 
program listing, together with program titles, program times, catiegories, 
channel livunbers and the Uke, from a central file server on the digital 
channel of program listings to the transceiver. The data is interleaved 
such that the current day's data is followed by other weekly data. 

A remote control device is preferably provided for 
communicating with the transceiver, and includes a nvunber of user 
selectable interactive functions such as: an info button, a list button, a 
categories button, a pbc button, a mark button, a jump button, a select 
button, and a pointing device consisting of a set of cross-hair arrow 
buttons (up, down, left, right) or other pointing devices capable of 
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providing the same functions (such as a mouse, thumb stick or touch 
pad). While viewing the TV, a user may pbtzuri additional information 
on a current program by depressing tile info button, and obtairung more 
detaUed information using tiie pointing device. By depressing tiie list 
button on the remote control device, the tr^ceiver displays a program 
listing of the current programs available for viewing. Through the use 
of the pointing device, viewers can scroll up aind down the program 
listing or view a highlighted program in full screen by pressing the select 
button. By pushing the right or left arrow buttons on the pointing 
device, program listings may also be viewed for different hours, days and 
up to several weeks in advance through the present invention's use of 
data interleaving. The depression of the categories button on the remote 
control device results in the display of a categories menu bar on the TV 
screen, which includes categories such as "all", "sports", "news" and 
"favorites". The selection of one of these categories results in tiie display 
of only programs within that category. Moreover, tiirough the 
depressions of botii the Ust button and the categories buttori, a program 
listing is displayed of the currentiy available programs witiiin the 
selected category. Through the use of tiie arrow buttons on the pointing 
device, category listings for different times and dates up to several weeks 
in advance may also be viewed. The selection of the favorites category 
results in the display of currentiy available favorite programs, including 
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programs that are frequently watched by a partiodar TV household, 
marked programs, or programs that match preselected user preferences. 

The depression of the pix button results in the display of a 
"visual menu" of multiple pichire-in-pichire (PIP) windows along the 
perimeter of the TV screen. Each of the PIP windows displays one of the 
programs currently being received by the A/ V transceiver in the last 
category selected by the viewer. The PIP vdndows are displayed at a 
variable frame rate (N) (depending on the number of windows), and are 
captured by one or more tuners in the transceiver. A center PIP window 
displays a larger video image (along with audio) of the currently 
highlighted PIP window. The other PIP windows can be similarly 
viewed by using the pointing device on the remote control. The 
depression of the mark button allows users to "bookmark" a particular 
program for later viewing. The depression of the jump button aUows a 
user to jtunp between previously marked programs. 

Additional features, functioi\s, and interface screens are 
available to the viewer using the teachings of the present invention, 
including a menu button for controlling other devices connected to the 
A/V transceiver (such as CD, VCR, etc.), a record button for maldng 
copies of programs onto connected A/V recording devices (such as VCRs, 
hard disks, etc), a pluraUty of control buttons for playing back, stopping. 



Copied from 10354344 on 08/25/2005 



wo 95/01056 



PCTAJS94/0687^ 



10 

rewinding, or fast-forwarding audio-visual programs on coimected A/V 
playback devices, a numeric keypad for diialing channel numbers, 
confirming financial transactions with personal identification numbers, 
an optional miaophone with talk button for supplementing the present 
user interface with direct voice commands through the use of voice 
recognition technology, a' pay-per view interface, and a hoine shopping 
interface, as well as other feaitures described herein. 
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RRTFF nPSCPTPnON OF THF. DRAWING S 

HGURE 1 is a functional block diagram of the audio-visual 
(A/V) systein of the present invention. 

nCURE 2 is d functional block diagram illustrating the 
major components of the audio-visual transceiver of Figure 1 in further 
detail. 

FIGURE 3a diagramatically illustrates the electronic 
spectrtim utilized by the present invention. 

FIGURE 3b conceptuaUy illustrates the present invention's 
use of an interleaving data stream to download program/service listiiigs, 
and other information, to the present invention's A/V transceiver. 

FIGURE 4a illustrates one embodiment of tiie remote 
control device of the present invention wittx the sUding panel in a dosed 
position. 
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FIGURE 4b illustrates the first embodiment of the remote 
control device of the present invention shov^n in Figure 4a with the 
sliding panel in an open position. 

FIGURES 5a and 5b illustrate a second embodiment of the 
remote control device of the present invention with no sliding panel 
and additional features. 

FIGURE 6 illustrates the present invention's full screen 
viewing function as viewed by a user with a graphic overlay panel which 
includes the current channel nvunber as well as the channel logo and 
identifier. 

FIGURE 7 illustrates the present invention's info function 
showing the first page of the basic information track ("info-track"). 

FIGURE 8 illustrates the present invention's info function 
with a second page of basic information, obtained by using the right 
arrow button on the remote control device. 

_ FIGURE 9 is an additional illustration of the info function 

of the present invention in which the user has requested a third page of 
information vising the remote control device. 
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PIGURE 10 illustrates the present mvention's use of the 
info function providing the user with additional tracks of information 
(such as the 'Tid Bits" information track), by using the down arrow 
button of the remote control device. 

FIGURE li is a further illustration of additional 
information tracks ("info-tracks"), such as this "Info Mart", accessible to 
the user of the present invention using the down arrow button of the 
remote control device. 

FIGURE 12 illustrates the present invention's use of the list 
function to display current program/service Ustings and to highlight a 
particular program. Viewers may scroll up or down that list by using the 
up or^bwn arrow buttons on the remote control device. 

FIGURE 13 illustrates the list function of the present 
invention in which the MTV programming during the hour of 8:00 to 
9:00 p.m. includes two programs, one starting at 8:00 p.m., the other 
starting after the previous program has ended; 

FIGURE 14 illustrates the list function of the present 
invention which allows the user to highlight the second program, which 
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(Starts at 8:10 p.m., using the right arrow button of the remote control 
device. 

FIGURE 15 is an jadditional feature of the list function of the 
present invention where the user marks the highlighted program with 
the mark button of the remote control device. 

FIGURE 16 iUiastrates the selectipn of ail alternate hoiirly 
time slot beginning at 9 p.m. using the right arrow button of the remote 
control device. 

HGURE 17 illustrates the selection of an alternate day for 
the program/service listing by depressing the right arrow button of the 
reinote control device. 

FIGURE 18 illustrates displaying of a record panel 
confirming the title and length of the program to be recorded/ along with 
a confirmation of which VCR and tape to record on, by depressing a 
select button in the remote control device. 

_ . FIGURE.-19 illustrates_the present invention's use of the 

select button on the remote control device while the program/service 
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listing is displayed to instruct the selected VCR or A/V recording device 
to make a copy of the highlighted program. 

FIGURE 20 illustrates the present invention's "reminder" 
feature, which automaticaUy displays a Uve pictme-in-picture (n^^ 
window of a previously inarked program when the program ii received 
by the A/V transceiver. 

FIGURE 21 illustrates the present invention's jump 
function, wherein pressing a jump button one the remote control device 
permits a user to jump directly to a hill screei^ view of a previously 
marked program, and wherein pressing the jump button again results in 
the display of another marked program. 

FIGURE 22 niustrates the categories function of the present 
invention which is displayed by pressing the categories button on the 
remote control device. 

FIGURE 23 hirdier illustrates the categories function 
wherein the "favorites" category is highlighted by pressing the right 
-arrow button (9n-&e remote control-device. 
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HGURE 24 further illiistrates the categories fiinction 
wherein the "sports" category is highlighted by depressing the right 
arrow button on the remote control device. 

FIGURE 25 illustrates a representative television image in 
the case where the "sports" category has been selected by depressing the 
select button on the remote control device. 

FIGURE 26 is a further illustration of a representative 
television image in which the "sports" category has been selected, and an 
alternate sports channel has been further selected by a user through the 
use of the up arrow button on the remote control device. 

FIGURE 27 illustrates a sports program listing in which the 
list button has been depressed after the "sports" category has been 
selected. 

FIGURE 28 illustrates the categories fimctibn in conjunction 
with the list fvmction. 

FIGURE 29 furth er illustratjBS the categories and list 
functions when the down arrow button is depressed on the remote 



Copied from 10354344 on 08/25/2005 



wo 95/01056 



PCT/US94/P6875 



17 

control device, breaking down the "sports" category into sub-categories 
such as baseball or football. 

FIGURE 30 is a jfurther illustration of the categories and Ust 
functions in which the category "favorites" is highlighted and can now 
be selected by depressing the select button or broken down into sub- 
categories by depressing the down arrow button on the remote control 
device. 

FIGURE 31 further illustrates the categories and list 
functions, where the "favorites" category has been broken down into a 
sub-category of "frequent" programs which are currently listed. 

HGURE 32 is a further illustration of the categories and list 
functions, where another "favorites" sub-category, "marked programs", 
is highUghted displaying a list of previously marked programs. 

FIGURE 33 conceptually illustrates the pbc ftinction of the 
present invention wherein multiple PIP windows are displayed by 
pressing the pbc button on the remote control device. 
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FIGURE 34 illustrates the pix function of the present 
invention in Which a new PIP window has been highlighted and is 
displayed in a larger format in the center of the display scrieen. 

FIGURE 35 is a further illustration of the present 
invention's pix function in which, through the use of the remote control 
device, a PIP window showing a pay-per-view program has been 
highlighted and is displayied in the center portion of the screen. 

FIGURE 36 illustrates the menu function which permits 
users to press a menu button to switch the television display to other 
audio-visual devices coupled to the transceiver, such as VCR, CD, on- 
line services, telephone, etc. For example, once VCR is selected, with the 
right arrow button, the TV displays an image from the videotape 
currently in the VCR and the user can press the play button on the 
remote to playback a previously recorded program on the video tape. 

FIGURE 37 illustrates one embodiment of the present 
invention for selecting a pay-per-view charmel offering entitled "Jeff s 
World" through the use of the select button of the remote control device. 

FIGURE 38 illustrates a preview feature of pay-per-view 
under the above illustrated embodiment. 
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HGURE 3? illustrates a credits feature of pay-per-view 
under the above illustrated embodiniei\t. 

FIGURE 40 illustrates an iiifo feature of pay-per-view under 
the above illustrated embodiment. 

nCURE 41 iUustrates a confinnation featiire for ordering a 
pay-per-view offering through the use of the numeric keypad on the 
remote control device imder the above illustrated embodiment. 

FIGURE 42 illustrates the reminder feature advising the 
user that the selected offering of pay-per-view will begin in three 
minutes under the above illvistrated embodiment. 

FIGURE 43 illustrates one embodiment of the present 
invention for selecting and interacting with a home shopping service 
(TV Shop) offering. 

FIGURE 44 illustrates a sample commercial shown to the 
—user if the home-shopping service -is selected through the use of the 
select button on the remote control device under.the above illustrated 
embodiment. 
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FIGURE 45 illustrates a menu permitting the user to select 
various shops available on the home shopping service using the select 
button pri the remote control device imder the above illustrated 
embodiment. 

FIGURE 46 is a further illustration of the hoine shopping 
siervice in which a cobkware product is highlighted under the above 
illustrated embodiment. 

FIGURE 47 is a further illustpratibn of the home shopping 
service in which a mini-espresso machine is highlighted, emd can be 
selected for ordering with the select button on the remote control device 
imder the above illustrated embodiment. 



FIGURE 48 is an information screen provided to the user 
after selecting a mini-espresso machine for ordering imder the above 
illustrated embodiment. 

E1GURE^9- is an order screen in which the tiser, vising the 

numeric keypad on the remote control device, enters a personal 
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identification riiimber to order the mini-espresso machine under the 
above illustrated embodiment. 

FIGURE 50 is a sample order confirmation provided to the 
user subsequent to ordering a product in the home shopping service 
vmder the above illustrated embodiment. 
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NOTATION AND NOME NCLATURE 

The detailed descriptions which follow are presented largely 
in terms of interface display images, algoritiuns, and symbolic 
representations of operations of data bits within a computer memory. 
These algorithmic descriptions and representations are the mearxs used 
by those skilled in the data processing arts to most effectively convey the 
substance of their work to others skilled in the art. 

An algorithm is here, and generally, conceived to be a self 
consistent sequence of steps leading to a desired result. These steps arie 
those requiring physical manipulations of physical quantities. Usually, 
though riot necessarily, these quantities take the form of electrical or 
magnetic signals capable of being stored, transferred, combined, 
compared, displayed and otherwise maiupulated. It proves convenient 
at times, principally for reasons of common usage, to refer to these 
signals as bits, values, elements, symbols, characters, images, terms, 
numbers, or the like. It should be borne in mind, however, that <dl of 
these and similar terms are to be associated with the appropriate physical 
quantities-^d_are_mer.ely_co.nye33ienUabels applied to these .quantities. 
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In the present case, the operations are machine operations 
performed in conjunction with a human operator. Useful machines for 
performing the operations of the present invention include general 
purpose digital computers, digitaUy controlled displays or other similar 
devices. In all cases, there should be borne in mind the distinction 
between the method operations of operating a coihputer and /or display 
system, and the method of cbmputatiori itself. The present invention 
relates to method steps for operating a computer and interactive display 
system, and processing electrical or other physical signals to generate 
other desired physical signals. 

The present invention also relates to apparatus for 
performing these operations. This apparatus may be specially 
constructed for the required purposes or it may comprise a general 
purpose computer selectively activated or reconfigured by a computer 
program stored in the computer. The method steps presented herein are 
not inherently related to any particular computer or other apparatus. In 
particular, various general purpose madunes may be used with 
programs in accordance with the teachings herein, or it may prove more 
convenient to construct more specialized apparatiis to perform tiie 
-required-me&od-steps^e-requir€d stiructiire for a variety of tiiese 
machines will appear from the description given below. Machines 
which may perform the functions of the present invention include tiiose 
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manufactured by the Assignee, Apple Computer, Inc., as well as other 
manufacturers of cpmiputer and computer controlled muti-media 
systems. 
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nFTAn.ED DPSrRTPtlON O F THF INVENTION 

The foUowing detaUed description will be divided into 
several sections. The first of these will describe a general system 
arrangement for receiving and generating the audio-visual user interface 
of the present invention. Subsequent sections will deal with the 
functiorxal aspects such as the present invention's interactive functions, 
which includes the info, list, record, mark, jump, category, pix and menu 
functions, as weU as the overaU structure and operation of the present 
invention's user interface. 

In addition, in the foUowing description, numerous specific 
details are set forth such as functional blocks representing data processing 
devices, and metaphors such as screen, menu and other configurations 
to assist the user in navigating through the user interface, etc:, to provide 
a thorough understancling of the present invention. However, it will be 
apparent to one skilled in the art that the present invention may be 
practiced without these specific details. In other instances, well known 
circuits and structures are not described in detail so as not to obscure the 
-present invention-unneeessarily. ^or' tiie purpose of this appUcation, the 
word "audio-visual" and its abbreviation, "A/ V", will be used 
interchangeably and wiU have the same meaning. 
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General System Configuration 

The mill ti-media interactive television system of the 
present invention is illustrated in schematic form in Figure 1. As shown 
in Figure 1, a cable or telephone service provider 50 provides cable 
television or telephone (T/T) services over a T/T cable 52 to a pluraUty of 
users coupled to the cable or telephone system, as is known. Although in 
this Specification reference is made to a cable television or telephone 
system, it will be appreciated by one skilled in the art that the present 
invention may be used in conjunction with a variety of other electronic 
transmission systems including satellite service systems, microwave 
systems, fiber optic, and radio frequency (RF) systems. 

As illustrated in Figure 1, the T/T cable 52 is coupled to an 
audio-visual transceiver 54 which comprises a number of separately 
identifiable modules. The transceiver 54 is intended to be located in 
proximity to and coupled to a VCR 56, a television (TV) 58, as well as one 
or more optional audio-visual devices 57 such as additional VCRs, laser 
disc players, camcorders, stereos, various storage devices, telephones, 
faxes and answering machines, as shown. Moreover, it is contemplated 
__that transceiver 54 m ay be directly ineorpoirated into the VCR 56 j. the TV 
58, or one the other A/V devices 57. As will be described below, a remote 
control device 60 commvmicates v\dth the transceiver 54 preferably 
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through a wireless tranismission signal (for example, an infrared (IR) 
signal), or other mechanisms known in the art. Additionally, as 
illustrated in Figure 1, the transceiver 54 is further capable of 
communicating with the television 58, the VCR 56 and the other A/ V 
devices 57 through infrared or other means. 

Referring now to Figures 1 and 2, the transceiver 54 
comprises three primary modules: a main module 62, an A/V connect 
module 66 and an optional compact disc read only memory (CD ROM) 
module 70. the main module 62 includes a central processing unit 
(CPU) 63 coupled over a system bus 64 to a system memory 65 and an 
infra-red (IR) control unit 82, which sends and receives wireless control 
signals to and from the remote control device 60. The CPU 63 is further 
coupled through the system bus 64 to a memory and bus controller 80, 
which is itself coupled through an A/V decoder 74 and an A/ V encoder 
78 to the A/V connect module 66, as well as to an optional CD ROM 
module 70. The CPU 63 is also coupled through the system bus 64, the 
_memo iT and bus con troller 80 and an A^V bus 73 to an A/V processor 77 
and an optional A/V memory 75. 

5he^7A^-GonneGt-^Qdule^6-switches. and receives, analog 

audio-visual signals and digital data from a plurality of audio-visual 
sources including the T/T cable 52, the video cassette recorder (VCR) 56, 
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or the other A/V devices 57, and couples those sigi\als and data to the 
main module 62 through the video decoder 74. The A/V connect 
module further switches audio-visual signals and data received from the 
main module 62 through the video encoder 78, and sends them back out 
to the T/T cable 52, the VCR 56, the other A/V devices 57 and/or the TV 
58. The A/V cormect module 66 includes a switcher 67 and one or more 
programmable timers/demodulators 69, wherein one 
timer/demodulator reads and displays a current program from one of the 
channels received over the T/T cable 52, and additional 
tuners/demodulators (or the same tuner/demodulator, used in 
alternation) are used to read and display data from the side-band 
chaimels in picture-in-picture (pip) windows. In addition, the A/V 
cormect module 66 may include descrambling circuitry (not shovm) to 
descramble premitmi programs received over the T/t cable 52. It is 
further contemplated that the A/V cormect module 66 provides a graphic 
overlay function that superimposes an A/V signal from the video 
encoder 78 agidnst another A/V signal from the T/T cable 52, the VCR 56, 
or the other A/V devices 57 allowing both signals to be simultaneously 
displayed on the TV 58, the VCR 56 or the other A/V devices 57. Finally, 
the A/y connect module 66 can be used to transmit data such as order 
- __jnf ormatiorUaJhe_cable_(T7^_service_pri3vider 50 oyer a back channel 
102 described below. 



Copied from 10354344 on 08/25/2005 



wo 95/01056 



PCT/US94/06875 



.■ 29 

The A/V decoder 74 is iised to derade data encoded in the 
vertical blanking interval or special side-band cable channels into digital 
data and couple them to the CPU 63 through the memory and bus 
controUer 80 and the system bus 64. Furthermore, the A/V decoder 74 is 
used to convert analog audio-visual signals from the A/V connect 
module 66 into digital A/V data and couple them to the A/V processor 
77 through the memory and bus controUer 80 and the A/V bus 73. 
Moreover, the A/V decoder 74 may be used to resize audio-visual signals 
from the A/V connect module 66 in order to aeate pichire-in-picture 
windows and the like. It is also contemplated that tite A/V decoder 74 
may be used to decompress certain analog or digital signals (such as 
MPEG motion video and the like) and couple them to the A/V processor 
77 through the memory and bus controller 80 and the A/V bus 73. 

The memory and bus controller 80 is used to route data and 
control signals between the system bus 64, the A/V bus 73, the A/V 
decoder 74, the A/V encoder 78 and the optional CD ROM module 76. 

_jrhe A/V bus 73 is a high-speed digital bus used to free up the system bus 
64 during the transmission of large amount of audio-visual data between 
the A/V processor 77, the optional A/V memory 75 and, through the 

-memory-andlms controllerJO,-the_ A/V. decoder 74, the AZY encoder 78, 
and the optional CD ROM module 70. The A/V processor 77 coupled to 
the A/Vbus 73 is used to manipulate, process, render, mbc and otherwise 
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re-arrange digital data into coherent audio-visual displays. An optional 
A/ V memory module 75 also coupled to the A/V bus 73 can be used to 
store A/V data before or after processing by the A/V processor 77 (using 
components such as video random access memory (VRAM) to hold, for 
example, a frame buffer equivalent to one 640 x 480 x 8-bit color image in 
memory). 

The A/V encoder 78, coupled to the A/V bus 73 through the 
memory and bus controller 80, is used to convert digital A/V diata from 
the A/V processor 77 or the optional A/V memory 75 into analog audio- 
visual signals which are routed to the TV 58, the VCR 56 or the other 
A/V devices through the A/V connect module 66. It is also 
contemplated that the A/V encoder 78 may be used to encode other data 
such as order information sent by the CPU 63 through the memory and 
bus controller 80 and the system bus 64 and trai\smit them to the service 
provider 50 through the A/V connect module 66 and a back chaimel 102 
described below. 



The CPU 63 is also coupled over the system bus 64 to a 
system memory 65 including both volatile and non-volatile memory 
-_components.J!he_nQn-volatQe .partjof system memoiy 65_includes read- 
only memory (such as ROM), which is used to store an operating system 
and playback software, fonts, sounds and the like used in the present; 
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invention. The non-volatile part of system memcMy 65 also includes 
rewritable memory (such as SRAM), which is u?ed for persistent storage 
of mark or record indicators, listings of programs viewed or taped, and 
other user preferences. Additionally, the volatile part of system memory 
65 includes sufficient random access memory (such as RAM or DRAM) 
for the temporary storage of data received over the T/T cable 52 or frora 
the other devices 56 - 58 connected to the transceiver 54. 

The transceiver 54 can also include an optional CD ROM 
module 70 coupled through the memory and bus controller 80 to the 
system bus 64 and the CPU 63. This optional GD ROM modxde 70 
constitutes a general purpose storage device to permit playback of optical 
compact discs (CDs), including multi-media CD ROM tities, audio CDs, 
photo CDs, and motion picture CDs on tiie TV 58. It is contemplated tiiat 
those taransceivers which do not include an internal CD ROM module 
could instead include a CD ROM interface allowing users to connect an 
external CD ROM drive to the transceiver 54 at a later date. It is also 
contemplated timt this CD ROM module 70 may in tiie futiire use 
different electronic, magnetic, optical or storage tedmolpgies other than 
the current CD ROM embodiment. 



Additional modules may be added to the tiansceiver 54 
including, for example, such options as a small computer system 
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interface (SCSI) for accessing digital storage devices such as hard disks, a 
modem for exchangii\g digital data over telephone lines, or a serial port 
for controlling other devices over a wired connection. Another triodule 
presently being contemplated is ia remote beeper button for locating the 
remote control device 60. Many consumers oftenmisplace their remote 
control devices, and it is contemplated that the present invention may 
provide a function wherein a speaker on remote control 60 would beep 
while the beeper button is pressed until the viser locates the remote 
control. 

Referring now to Figure 3a, there is shown one possible 
electronic spectrum of signals provided by the cable T/T service provider 
50 over the T/T cable 52 to the transceiver 54. As illvistrated in Figure 3a, 
the spectrum includes at least one digital program listing channel 100, a 
plurality of back charmels 102, and a plurality of standard analog TV 
channels 103. In addition, and as will be described more fully beloW, the 
spectrum includes pay-per-view digital channels 106, and further 
additional definable digital channels 108 offering a variety of interactive 
services, in addition to the general purpose or special channels or 
services particular to the specific application of the present invention. 

As illustrated in Figure 3b, the digital program listing 
chaimel 100 provides data representing daily and weekly program 
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Ustings and related irxfonnation from the service provider 50 to the 
transceiver 54. As shown in Figure 3b, the listing chaimel 100 iridudes a 
repetitive data stream having data representing today's Usting 110 
interleaved with weekly Ustings. For example, there is shown today's 
data 110, foUowed by Monday's data 112, and then once again followed by 
today's data 110. As seen in Figure 3b, Tuesday's dat^ 114 is followed 
once again by today's data 110, and thereafter by Wednesday's data 116. 
Wednesday's data 116 is followed by today's data 110, and thereafter by 
Thursday's data 118. Thursday's data 118 is followed once again by 
today's data 110, and thereafter by Friday's data 119. Finally, following 
today's data 110, Monday's data 112 is once again transmitted along the 
data stream provided by the service provider 50. For programming 
purposes, the data preferably will include titles of programs, show times, 
special captions, length information, categories, and key words, as well as 
channel numbers provided from the service provider 50 over the T/T 
cable 52, and received by the transceiver 54. The data stream is an 
interleaved data stream which repeats on a weekly basis as shown in 
Figure 3b, jLiLPresently contemp lated giat giere would be at least 100 
different diannels of programs and/or services. A weekly 
program/service Usting with information relating to 100 channels of 

programsAervic-es-could-r€quire.over-2jnegabytes.of.informati^^^^ 

data stream of programs/services Usting information (Ulustrated in 
Figure 3b) is received by the transceiver's main CPU module 62, 
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whereafter the sections that are most relevant to the users are stored in 
the system memory 65. By interleaving the current day's data with the 
weekly data, the daily data, the CPU modvile 62 can update the system 
memory 65 periodicaUy and still provides quick access to the viewer, 
without having to store all the received program /service information, 
thereby reducing the amomt of system memory 65 required and the 
associated hardware cost, 

Referring once again to Figure 3a, the back channels 102 are 
used to engage in a variety of transactions, such as ordering products, 
home banking services and pay-per-view movies, as will be described 
more fully below. In operation, any request by a viser to view a pay-per- 
view movie or order a product is tranismitted to the service provider 50 
over at least one back chaimel 102 through the T/T cable 52. It is 
contemplated that as channel capacity increases, so will the number of 
back channels, allowing for broader band two-way commimications such 
as telephone conversations or interaction with on-line networks. 

Referring now to Figures 4a, 4b, and Figures 5a and 5b, two 
alternative embodiments of the remote control device 60 are shown in 
—— further-detail. Jt4s-expected4hat4hemodd and 5b 

would be more con:\monly used. As illustrated in the figures, both 
embodiments of the remote control device 60 are comprised oif ifour 
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cpntroi button groups 115, 134, 160 and l76. These confarol button groups 
115, 134, 160 and 176 will first be described briefly here, and their usage 
will be diescribed in further detail below. 

The first control button group is the basic control button 
group 115 which includes standard television control buttons such as 
power on/off button 120, volume control button 122 and a mute button 
125. Moreover, channel up/down buttons 130 aire provided to the 
embodiment illustrated in Figures 4a and 4b to increment or decrement 
the currently viewed chaimel on television 58, as is well knowru For the 
embodiment illustrated in Figures 5a and 5b, the chaimel control 
function is effectuated using the up and down arrow buttons 145 and 146. 

The second control button group is the interactive control 
button group 134 which includes an info button 136, a list button 138, a 
categories button 140, arid a mark button 142. The info button 136 
permits the user to obtain mtiltiple levels of information on programs 
wkile tiie user is watching one of the program offerings on tiie TV 58 (or 
other A/V devices). The list button 138 permits the user to view listings 
for programs /services. In the presently preferred embodiment, when TV 
- is selected,-the-list button 138-pennits .the_user to view current_and. future 
TV listings up to one week in advance. The categories button 140 
permits the viewer to select programs/services by category. For example, 
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and as will be described below, the user may desire to watch only sports 
programs, only news programs, or the like. As will be disclosed, the 
categories button 140, and the list button 138 operate in concert to 
provide listings of selected categories, such as sports or news programs, 
on the TV 58. The mark button 142 permits the loser to mark programs 
for reihiriders, later recall, or switching between programs which have 
been selected using the mark button 142. A jump button 132 lets the user 
switch to the program that was last marked, then to the program that was 
marked before that, and so on, until all marked programs have been 
shown, looping back to the last marked program again. As shown in 
Figures 5a and 5b, the jump button 132 and the mark button 142 are 
placed side by side together on the dividing line betweei\ the first and 
second control button groups 115 and 134 to emphasize their 
interrelation. 

Also provided with the interactive control button group 134 
is a pointing device consisting of an up arrow button 145, a down arrow 
button 146, a left arrow button 148, and a right arrow button 150. For 
example, if the viser is viewing a program/service listing through the use 
of list button 138, and desires to scroll up or down within the listing, the 
u p arrow button 145 and the d own a rrow button 146 are utilized. In 
addition, a center select button 155 is provided for permittii^ the user to 
select one of several choices, represented by words or icoiis in graphic 
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menus or Usts displayed on the TV 58, for example a "bull's eye" as 
shown in Figure 5a. As will be described, the interactive coritrol button 
group 134 may be used in a variety of appUcations, including selection of 
pay-per-view channels, home shopping services, and the like, as weU as 
to display and control programs from other A/V devices connected to 
the transceiver 54. 

Tlie third control button group is the avudliary control 
button group 160 comprising various A/V control buttons for 
controlling the VCR 56 or the other A/V devices 57 connected to the 
transceiver 54. As illustrated in Figure 5a, the auxiliary control button 
group 160 includes a record button 162, a rewind button 164, a stop arrow 
button 166, a play/pause button 168, a fast forward button 170, and a 
menu button 172. In accordance with the teachings of the preseiit 
invention, the user depresses the record button 162 while watching a 
television program ori TV 58, which brings up a record panel confirming 
the current program's title and length, along with a highUghted select 
icon and c onfirmation of w hich A/V device and ^e to use for 
recdrdirtg. Once the center select button 155 is depressed, the VCR 56 or 
the other selected A/V device 57 begins to record the program currently 

being-view€d^5^e^r^ternativ-dy^.ifihe„user.has_pressed^^ 

button 138, and a program listing is highlighted, pressing the record 
button 162, and then the center select button 155 results in the VCR 56 
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being progranimed to record the particiilar show highlighted in the 
program listing; Pressing the menu button 172 displays icons for all the 
A/V devices 57 currently connected to the transceiver 54 and allov^^s 
users to select another device v^rith the arrow buttons. Pressing the center 
select button 155 displays the output of that device and lets the user 
control that device. 

The fourth control button group is the numeric keypad 
panel 176, which permits the user to directly enter channel nimibers to 
be viewed on the TV 58 by pressing a single, double or triple digit 
number, followed by the ok button 178 (Fig. 5a). For the remote control 
device 60 shown in in Fig 4b, the user would depress the select button 155 
after entering values usirig the keypad 176, In addition, the numeric 
keypad 176 may be used by the user to enter a personal identification 
number ("PIN"), to be traiismitted to the service provider 50 through the 
A/V cormect module 66 for payment of pay-per-yiew movies, products 
and the like. 



In addition to the control button groups, both embodiments 
comprise a transmitter (not shown) for transmitting signals to the audio- 

yisual system Adriirinnally, the model illustrated in Figures 5a - 5b is 

further provided with a talk button 181, a miciophone 179, a speaker 182 
and a receiver (not shown). The talk button 181 when depressed allows 
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the user to speak into the microphone 179, thereby providing input to 
the A/V system through voice, and receive voice feedback from the A/V 
system through the speaker 182. 

Full Screen V ipwing Function 

Referring now to Figure 6, there is shown a representative 
full screen audio-visual program displayed on the screen 180 of the TV 
58. By depressing the channel up/down buttons 130 on the remote in 
Figures 4a and 4b, (or by depressing the up and down arrow buttons 145 
and 146 on the remote control device in Figures 5a - 5b), users can switch 
Channels as is commonly done with regular TV remotes. As the user 
selects a channel to view using the remote control device 60, a graphic 
overlay panel 185 is displayed in the lower right hand portion of screen 
180. As illustrated, the graphic overlay panel 185 includes the channel 
i^umber currently being viewed 186 along with the channel logo and 
identifier 188. Additionally, a marking identifier 189, such as a check 
mark, is also displayed, as wiU be descr^jed, to indicate that the program 
has been marked through the use of the mark button 142 previously 
discussed with reference to the remote control device of Figures 4a, 4b, 
— =and Figures-Sa-and-Sb.— : 
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information Function 

Referring now to Figure 7, there is shown the screen 180 in 
which the iriformation (info) function 136 iias been requested by the 
user. As the user is watching a particular television program on the TV 
58, he may depress the info button 136 to obtain information in the form 
of a graphic overlay panel 190 on the screen 180. In operation, the 
transceiver 54 coupled with the main module 62 through the A/V 
cormect module 66 superimposes the graphic overlay panel 190 against 
the currently displayed video image. This process is also used in other 
functions, such as the full screen viewing function, where the graphic 
overlay panel 185 is superimposed on the screen 180. The overlay 
graphic panel 190 contains an "i" logo 192 indicating that the 
information button 136 has been depressed, and also displays the title of 
the currentiy viewed program 194 ("Showbite This Month" in this 
exairiple), a category name 196 ("News" in this example), and the length 
of the overall program ("60 min" in this example). In addition, the 
charmel number and network logo ("8" and "CMM" in this example) are 
also provided to the user. Also, as illustrated in Figure 7, the overall 
length of the currently viewed program is graphically illustrated, by a 
time bar 200 showing how much time rema ins before the program ends. 
A left arrow 201, a right arrow 202, and a down arrow 210 are displayed 
and highlighted to indicate that the left arrow button 148, the right arrow 
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button 15o/and the down arrow button 146, of the remote control device 
60 can be depressed to cause additional information to be depressed. An 
up arrow 205 is also displayed, but is not highlighted, to indicate that no 
additional information will be displayed if the up arrow button 145 is 



Referring now to Figure 8, which illustrates a new graphic 
overlay panel 190 displayed in response to the user having depressed the 
right arrow button 150 on the remote control device 60 whUe using the 
information function. The transceiver 54 provides additional 
information on the currently viewed program. As illustirated, an 
additional page of information pri tiie program currentiy viewed is 
displayed. For example, additional guests on the show "Showbits This 
Month" include "Madeline, Harold Black and Harmer". Referring now 
to Figure 9, which illustirates another new graphic overlay panel 190 
displayed in response to the user having depressed the right arrow 
button 150 again. A third page of information is displayed on tiie screen 
180 relating to the oirrentiy viewed program "Showbits this Month". It 
will be noted that the currently viewed television program ("Showbits 
This Month" in this example) continues to be viewed in the main 
__portionu)£ihe-ScrfienaaQ,J4Me_di^^ 

superimposed over tiie lower tiiird portion of tiie screen 180. 
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In the airrently preferred embodiment, a user may 
selectively move between pages of information relating to the currently 
viewed program by pressing the right arrow button 150 or the left arrow 
button 148 on the remote control device 60, or alternatively, the main 
module 62 will automatically scroll through the various pages of 
information with a pre-determined ampimt of display time for each page 
of information. 

Referring now to Figure 10, there is shown a ctirrently 
viewed baseball game entitled "Saint Louis at San Francisco" displayed 
on the screen 180. Assume now the user also depresses the info button 
136 on the remote control device 60. As previously described, 
information relating to the cxirrently viewed program is displayed 
within the graphic overlay panel 190. (n the present example, 
information relating to the baseball player, "John Smith", is provided 
within the overlay 190. In the event the down arrow 210 is highlighted, 
an additional information track is available to the user. This additional 
information track may be displayed through the use of down arrow 
button 146 on the remote control device 60, and is referred to here as 
'Tid Bits". As shown in Figure 10, the 'Tid Bits" information track gives 
additional i nformation relating to the partictilar subject currently being 
displayed on the screen 180. In the example of Figure 10, the first 
baseman John Smith is currently being viewed on the screen 180, and 
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information relating to John Snuth is provided in the graphic overlay 
panel 190. It will also be noted that in Figure 10, the down arrow 210 is 
highlighted, indicating that yet another information track is available. 

Still referring to Figure 10, it will be noted that a down 
arrow 210 is shown. By depressing the down arrow button 146 on the 
remote control device 60 once again, an Info Mart track information 
track as shown in Figure 11 is displayed by CPU 63 in the graphic overlay 
panel 190. As illustrated, the Info Mart information track provides the 
viewer with the opportunity to purchase products, services, programs 
and the like related to the program which is currentiy being viewed (in 
the present example, the baseball game "Saint Louis at San Frandsco"). 
The information track disappears when the info button 136 is pressed 
again. 

While the information has been described with the left and 
arrow arrow buttons 148 and 150 causing different pages of an 
Jnfbrmation track to be displayed, and ttie up and down arrow buttons 
145 and 146 causing different information tracks to be displayed, it is 
contemplated that the information displayed may be related to each 

._^ther-in-other-appUcation dependent 'manners. It is furtiier _ 

contemplated that this information function can also be used with 
audio-visual programs or services other than TV shows, in particular 
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when the menu button 172 is used to display the output of the VCR 56,. 
the CD 70, a hard disk, a telephone or another other A/V device 57 
coruiected to the trarwceiver 54. 

The data comprising the information of the various 
information tracks shown in Figures 7-11 are downloaded using the 
method illustrated in Figure 3b, i.e. the interleaved data stream 
tiransmitted from the service provider 50, to the transceiver 54. The data 
are stored in the system memory 65 and updated as new data are received 
over the digital program listing chaimel 100. Alternatively, data 
displayed in the information tracks such as the exemplary Tid Bits or 
Info-Mart information tracks may be transmitted by the service provider 
50 to the transceiver 54 using the vertical blanking intervals, which are 
inherently part of the analog TV channel 103 used to display the 
currently viewed program on the TV 58. In another embodiment, data 
comprising the informatiori tracks may be transmitted and dowiUoaded 
through the use of separate info-track channels comprising additiorwl 
channelsin the electr onic s pectrum illustrated in Figure 3a. 
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l ist Function 

Referring now to Figure 12, the list function of the present 
invention will be described. While viewing a television program 
displayed on the TV 58, the user may depress the list button 138 on the 
remote control device 60 to obtain a program/ service listing for the 
current date and time during which the user is watching television. As 
shown in Figure 12, upon depressing the Ustbuttori 138, a 
program/service listing 220 is displayed for the ciirrent date and time at 
which the viewer has depressed the list button 138, As illustrated, 
programs/services currently available for viewing and interaction are 
identified by their charmel numbers, channel name identifiers (for 
example, Charmel 10, NTV), and by titles of the programs/ services. In 
the event that the program/service listing includes two programs for a 
given time interval, then the names of both programs are displayed. For 
example, in Figure 12, Channel 10 is NTV which beginning at 8:00 p.m. is 
showing a program entitled "Rock Today", and beginning at 8:10 p.m. is 
shnwihg a program called 'Tart y Tim e". In addition, as shown in Figure 
12, a picture-in-picture window 250 continues to display the currently 
viewed program which the user was last viewing. Accordingly, the user 
—may-coittinue to^iew-the-^urr^tiy-selected program,-^ 

program/service Usting simultaneously. By pressing the select button 
155 in the current time slot, the user can view the currently highlighted 
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program in full screen, as long as that program is playing live at the 
current time. For example, in the case of Figure 13, the pressing of the 
select button 155 would display NTV's "Rock Today" prograin in full 
screen. It will be noted that although the current implementation of the 
list function displays a list of programs /services on single lines for one 
hour time slots, the invention's user interface also supports other styles 
of display, for example, a grid showing programs on two lines, each line 
representing a two hour time slot. 

It will also be noted that tiie currentiy selected pro-am 
being displayed in the picture-in-picture window 250 is iiutially 
highlighted in the program/service listing to assist the user. In the 
example of Figure 12, Channel 11, PBS, a show entitied "Say Nay Billy" is 
highlighted. Moreover, channels may be selected by pressing the up 
arrow button 145 or the down arrow button 146 on the remote control 
device 60 to move the highlighting over to alternate program/ service 
offerings. For example, if the user presses the down arrow button 146, as 
sh own in Figure 13, the NTV l isting is then highlighted. Similarly, as 
shown in Figure 14; by continuing to depress the down arrow button 
146, the highlighting continues to move upward towards the lower 
-channel number s a nd oTirp the MghUghting reaches C.haimel9^.aie. J . 
entire program/service listing scrolls to display consecutively lower 
channel numbers previously not displayed. At the same time, the 



Copied from 10354344 on 08/25/2005 



wo 95/01056 



PCTAJS94/06875 



higher channel nvimbers previously displayed at the bottom part of the 
screen 180 will consecutively disappear. As illustrated in Figure 14, 
Channels 7 and 8 are now displayed, and Channels 19 and 20 are no 
longer displayed to the user. If the up ar^ow button 145 is now pressed 
instead, the highlighting will moye down towards the higher channel 
riumbers as illustrated in Figure 14. Notably, movement of the 
program/service listing and the highlighting in the present invention 
are specifically calculated to conform with an average person's 
expectations in using a television remote control. While the list 
function has been described with the down arrow button 146 causing 
highlighting to move towards the lower channel numbers, and the up 
arrow button 145 causing highlighting to move towards the higher 
channel numbers, it will be appreciated that the correspondence between 
the arrow buttons 145 and 146 and the highlighting movement may be 
implemented in other ways as best suits the anticipated user of the 
interface system. 

Skipping no w to Figure 16, a further featiure of the list 
function of the present invention is Ulxistrated. In the event the user 
depresses the right arrow button 150, ttie CPU 63 displays the next hourly 
_^e-sl©t4isfeg-on-Ae-scr^nJ80.-Jn-the-example-pfJigure_16 
slot for 9:00 - 10:00 p.m. is illustrated. It will be appreciated that, had the 
user depressed the left arrow button 148 three times, then the 
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program/service listing for 6:00 - 7:00 p.m. would have been displayed. 
Additionally, as illustrated in Figure 17, the continued depression of the 
right arrpw button 150 for a predetermined amoimt of time (in the 
present embodiment for more thari 2 iseconds) results in the display of 
program/service listings for subsequent days. In this case, the continued 
depression of the right arrow button 150 has resulted in a scanning of the 
program/service listings through to Saturday, October 17. It will be rioted 
that in the currently preferred embodiment, a scaiining of subsequent 
days resultis in the display of the program/service listing from the 
beginning of prime time, namely, 6:00 p.m. (or 7:00 p.m., at the service 
provider's option). It will also be noted that the info function can be 
used in conjunction with the list function to display program/ service 
information about the currently highlighted program/service. It will 
further be noted that the listing display will disappear if the user 
depresses the list button 138 once again. It is also contemplated that this 
list function can be used with audio-visual programs or services other 
than TV programs, in particular when the menu button 172 is vised to 
display the output of other A/V devices 57. For example, if the VCR 56 is 
displayed on the TV 58, pressing the Ust button 138 on the remote control 
device 60 would display a listing of all programs recorded by the user on 
-the VCR 56, highlighHng the program now displayed frpmjhe y^ 56. 
Similarly, the list function would display CD ROM or telephone listings 
when these A/V devices are selected through the menu function. 
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Wprnrd Funcrion 



Referring now to Figure 18, which illustrates a 
program/service listing displayed in response to the user having 
continuously depressed the right arrow button ISO.on the remote control 
device 60. The exemplary program/ service listing displayed is for 
Saturday, October 17 beginning at prime time (6:00 p.n\.). T^^^ 
down arrow buttons 145 and 146 on the remote control 60 are then used 
to highUght the program "Specials Tonight". Assume now the user 
desires to record the exemplary program "Specials Tonight". By pressing 
the record button 162 on tiie remote control device 60, a record panel 259 
is displayed by the CPU 63 on the screen 180, confirming the title and 
length of the program to be recorded, along with a highlighted select 
("bull's eye") icon as shown in Figure 18. It is contemplated that other 
hinctions can be included in the record panel 259, sudx as a hmction for 
selecting different VCRs or other A/V recording devices, a function for 
_c^.rtit.E different ta pes or r eading. media, Mid/or a function for selecting 
how often the recording is to take place (once, weekly, daily). Once 
select button 155 is pressed, the program listing is redisplayed witinout 
— ^^ecord-^anel-4S9.^^^eord4c-on2604s-displayed,on-the-screenl8^^ 
shown in Figure 19. The "Specials Tonight" program which will begin 
on Sahirday, October 17, will then be recorded automatically. In the 
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event the viewer chzinges his mind and does not desire to record the 
program "Specials Tonight", by piressing the record button 162 again and 
then pressing the select button 155 once more, the program listing will be 
redisplayed without the record icon 260 tind no recording will take place. 

Mar]k and |ump Fnnctipffs 

Skipping now to Figure 15, the mark fimction of the present 
invention and its operation will be described- Shown in Figure 15 is a 
program listirig reflecting Channel 10 (NTV) having been selected using 
the up and down arrow buttons 145 and 146 on the remote control device 
60. Assume now the current time is 8:08:30 p.m. In accordance with the 
teachings of the present invention as described earlier, the program 
"Rock Today" would be highlighted on the iscreen 180. The program 
Tarty Time" may be highlighted by the viewer by pressing tiie right 
arrow button 150. The mark function may then be initiated by pressing 
the mark button 142 on the remote control device 160. As illustrated in 
Figure 15, a mark identifier 252 is displayed adjacent to the selected 
program (in the present example, 'Tarty Time"). Skipping again to 
Figure 20, a reminder box 254 is displayed on ttie screen 180 at the time 
the program Tarty Time" begins (in the present example, 8:10 p.m.), 
regardless of what chaimel is currently being viewed then by the user on 
TV 58. It should also be noted that programs playing live in a current 
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tiine slot can be marked whUe displayed in ftdl screen by depressing the 
mark button 142. This causes a mark identifier 189 to be displayed in the 
graphic overlay panel 185, as shown in Figures 6 and 21. 

Referring now to Figures 20 and 21, depressing the jump 
button 132 whUe the reminder PIP window 254 is displayed switdies the 
program displayed in the main viewing area of the screen 180 to the 
program which the user has previously inarked (see Figure 21). If more 
than one program has been marked, by repetitively depressing the jump 
button 132, users can jump to the other previously marked programs 
displaying them in fuU screen in the main display area of the screen 180 
one at a time. It wiU be appreciated that in an alternate embodiment, the 
picture-in-picture window 254 illustrated in Figure 20 may be precededby 
a reminder icon displayed automatically in the PIP window 254 a few 
minutes prior to the achial start of the program. It will also be noted that 
the mark and jump functions may be used with audio-visual programs 
other thanTV shows, allowing a user to mark and subsequently jump 
bet ween, for examp le, a VCR prograin,_aCD ROM program, a^ on-line 
service or an answering machine message, in addition to the TV 
programs previously marked while viewing television channels. 
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Categories Function 

Referring now to Figures 22 - 32, the categories function of 
the present invention will be described. To initiate the categories 
function of the present invention, the categories button 140 is depressed 
on the remote control device 60. As illustrated in Figure 22, the CPU 63 
displays a categories graphic overlay panel 300 which is superimposed 
over the ciuxently viewed program on screen 180. A plurality of 
categories are identified by representative icons. The first category which 
is selected by default is the "all" category 302, and is highlighted around 
the border. The "all" category 302 refers to all currently available 
programs/services being transmitted by the service provider 50. By 
depressing the right arrow button 150 or left arrow button 148 on the 
remote control device 60, other categories may be highlighted. For 
example, by depressing the right arrow button 150, the next category 
"favorites", as indicated by a star icon 305, is highlighted (See Figure 23). 
Similarly, by depressing the right arrow button 150 again, a movies icon 
310 is highlighted. By depressiilg the right arrow button 150 another 



time, a sports icon 315 is highlighted (see Figure 24), and so on. 
Additional categories may include a nevy^s icon 312 and a music video 
ico n 313. However, it will. be appreciated that m any other categories can 
be displayed. By repeatedly pressing the right arrow button 150, the user 
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can make category icons appear, scrblling from right to left against the 
category overlay panel 300. 

In Figure 24, the sports category has been highlighted by the 
user as indicated by the Wghlighted sports icon 315. To select a category 
that is currently highlighted, the user can press the select button 155 and 
the category overlay panel 300 disappears while the currently viewed 
program displayed on the screen 180 is replaced by the nearest available 
program in the category jxist selected. The selection of the sports category 
results iii the display of only sports related programs on the TV 58. 
Figure 25 illustrates an exemplary baseball game which is displayed after 
the user presses the select button 155. As illustrated, the sports icon 330 is 
also displayed in the graphic overlay panel 185 along with the channel 
identifier 188. 

Assume now after the nearest sports program has been 
displayed on the screen 180, the user desires to view additional sports 

_category jMOgrams on the TV 58. By depressing the up chaimel button 
130 or the up arrow button 145 on the remote control device 60, the 
transceiver 54 displays the next higher nvimber channel which is 

-currendy-shovy^g a-sports^gram. Jn the-example of Figure 26,,.^ 
sports program relates to a windsurfing event. As shown, the sports icon 
330 continues to be displayed along with the numerical channel indicator 
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and the channel identifier 188 (in the example of Figure 26 "Sportstime") 
in the graphic overlay panel 185. 

Referring now to Figure 27/if the user has selected the 
category of sports (icon 315), and depresses the list button 138, a 
program/service listing 360 of currently available sports programs is 
displayed on screen 180. It will also be noted that the currently viewed 
sports program will continue to be displayed in a picture-in-picture 
window 365. As previoiisly discussed, with respect to the list function, 
programs which are shown during half hour intervals (See Figure 27 
"Windsurfing" and "Basketball") are identified and inay be individually 
selected using the remote control device 60. 

Referring now to Figure 28, which illustrates a program 
listing with the sports icon 330 in tiie category overlay panel highlighted, 
displayed in response to the user having pressed the list button 138, and 
then presses the categories button 140. Assume now the user desires to 
break down the main sports category into finer sub-categories such as 
baseball, football, basketball, hockey, etc By depressing the down arrow 
button 146 on the remote control device 60, the user causes the GPU 63 to 
select f» Hpfaiilt spnrt sub-category (baseball in this example) and display: A 
plurality of sports sub-category icons against the categories overiay panel 
300 as iUustrated in Figure 29. The default sports sub-category icon 315 is 
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also highlighted, and the program listir\g 361 comprises only programs of 
that sports sub-category, i.e. baseball in this example: By pressing the 
right arrow button 150 on the remote control device 60, the user can 
highlight the football sub-category icon 317, then press the select buttorx 
155 to cause only football programs to be.listed. Alternatiyely, the user 
can press the up arrow button 145 to display the main categories again, 
with the sports icon 315 highlighted as illustrated in Figure 28. The user 
can also press the categories button 140 once more td make the categories 
overlay panel 300 disappear. 

Referring now to Figure 30, which illustrates a program 
listing 320 with the favorite icon 305 in the category overlay panel 
highlighted, displayed in response to the vise having selected the 
"favorites" category using the left arrow button 148 oi\ the remote 
control device 60. The program listing 320 compirises favorite programs 
for the current time slot including frequently viewed programs, marked 
programs, and programs to be recorded, as weU as progranw that match 
specified user preferences. Assume no w that the user desiresto resolve 
the "favorites" category into finer sub-categories. By pressing the down 
arrow button 146 on the remote control device 60, the user causes the 
--^€PU-63-to-display-a-flur^li^f^av«rites^ub<ategoiy4^ 
categories overlay panel 300, as illustrated in Figure 31. The CPU 63 
highUghts the "frequent" programs sub-category icon 318 and displays a 
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program listing 362 of programs most frequently watched by the user as 
determined by the CPU 63 from previous morutoring of the user's 
viewing habits. In the normal course of operation, the CPU 63 morutors 
programs which are most frequently viewed and compiles a prioritized 
list of those frequent programs for each time slot, which list is stored in 
the rewritable non-volatile part of the system random access memory 
(such as SRAM) 65. 

In the presentiy preferred embodiment, if a viewer views a 
television program for more than 10 minutes, the current program arid 
charmel identifiers are compared to frequent programs already stored in 
system memory 65 for that particular time slot, and an updated list of 
frequent programs is created by CPU 63 and stored in the system memory 
65. In the event there are no frequent programis stored in the system 
memory 65 for aiiy particular time slot, then a general list of most 
frequently watched programs is retrieved from the system memory 65. It 
is anticipated that the majority of frequent programs will be stored in 
time slots corresponding to prime time, or during dajrtime television 
hours. 

Ry presjiing the right arrow button 150, the user can move „ 

the highlighting from the "frequent" programs sub-category icon 318 to 
the "marked programs" sub-category icon 319, as shown on Figure 32. 
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Accordingly, the CPU 63 highlights the "marked programs" icon 319 and 
displays a program listing 363 of only programs that have been 
previously marked. Other favorite sub-categories include a record sub- 
category of all programs selected for recording, and personalized favorites 
sub-categories such as "Mom" 321 and "Joe" 322. It is contemplated that 
new preferences can be defined by individual users by selecting a special 
favorites sub-category, represented by a "set-up" icon 323, then marking 
preferred items from a list of programs and/or categories, as well as 
specifying an icon and/or a name for this new preference set. By first 
defining and subsequently selecting, for example, the "Mom" sub- 
category icon 321, a user can view only programs that match the interests 
defined earUer by the mother of the household. 

It is also contemplated that this category function can be 
used in combination with A/V programs or services other than TV 
programs, in particular when the menu button 172 is used to select the 
VCR 56, or one of the other A/V devices 57. For example, pressing the 
categories button 140 whUe viej^g a VO^^^ would 



enable users to find all previously recorded comedy programs. Similarly, 
the categories function could enable users to find phone listings in the 
-^ar^ening^g^ty^ccordingJoJelephone_directoty^^ 
accessed from the provider 50 via the T/T cable 52. 
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While the present invention has been described with the 
categories function having different effects on the displayed image when 
used during full screen display and when used in conjunction with list 
function/ it will be appreciated that the present invention also may be 
practiced with the categories fvinctipn having consistent effect on the 
displayed image in either situation, as desired. 

Pix Function 



Referring now to Figures 33 and 34, the present invention's 
picture-in-picture (or pix fimction) will now be described. The 
depression pf the pix button 144 on the remote control device 60 results 
in the display of a pix display 381 as illustrated in Figure 33. As shown in 
the present embodiment, 12 picture-in-picture video windows are 
arranged within the screen 180, along the perimeter of the pix display 
381, with a central picture-in-picture window 375 also displayed. 
Depressing the pix button 144 on the remote control device 60 results in 
the simultaneous display of multiple programs currently transmitted 
over the T/T cable 52, the VCR 56, the CD ROM 70 and/or the other A/V 
devices 57. Moreover, one of the picture-in-picture windows displaying 
3uch,as,_fpxLexagyia.-^iuJg^i3^ 
picture window 380, is highlighted. As shown in Figure 33, the 
highlighted smaller screen is also displayed in larger size in the central 
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picture-in-picture window 375, with the audio track of the program also 
audible to the user. Accordingly, a user may watch a motion picture or 
television program, including the audio track, in window 375, whUe 
viewing miiltiple other programs simultaneously. In the preseritly 
preferred embodiment, the A/ V connect module 66 samples (or "grabs") 
a video frame from each of the 12 programs every pre-deterniined (N) 
number of frames. Accordingly, a user viewing the pbc display 381 
perceives each of the 12 small pictxire-in-pictiire windows as sequential 
representative images of every N frames per window. However, the 
pichire-in-pichire window 375 represents a full motion display of the 
currently selected program, provided that a secoixd TV tuner 67 is 
induded within the A/ V connect module 66. 

Additionally, in the preferred embodiment of the present 
invention, it is contemplated that the user is able to view the pix display 
381 by category by pressing the categories button 140 and selecting a 
particular category, such as favorites or movies. For example, the pix 
display 38 1 illustrated in Figure 33 is comp rised of onl y favorite 
programs, as the user had previously selected the favorites category. Had 
the user selected the "marked" sub-category, only marked programs 
-^ouM43e-displayed-on4he4Jbc4ispla5L381,-aUowing^^ 
delete programs in the pbc display 381 by using the mark button 142. If 
no categories have been selected (which is equivalent to selecting the "all 
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programs" category), then the pix display 381 displays the 12 programs 
nearest to the last selected program. Similarly, pressing the info button 
136 would display the graphic overlay panel 190 shown in Figure 7 for 
program information. 

Referring now to Figure 34, which illustrates the selection 
of a different pix program to be viewed in the central picture-in-picture 
window 375. By depressing the left arrow button 148 on the rernote 
control device 60, the highlighting 380 is moved one window to the left. 
In the example of Figure 34, a "Discover It" program is now highlighted 
and shown simultaneously in the central picture-in-picture window 375. 
Similarly, through the use of the left arrow button 148 and the right 
arrow button 150 along with the up arrow button 145 and the down 
arrow button 146 on the remote control devicie 60, each of the pix 
programs in the pix display 381 may be viewed within the central 
picture-in-picture window 375, as desired. As in the list function, 
pressing the select button 155 displays the currently highlighted program 
in full screeiv Alternatively, pressing the pix button 144 a second time 
causes the pix display 381 to disappear arid the last highlighted program 
appears in full screen. 



Referring to Figure 35, selection of pay-per-view movie 
currently shown in one of the picture-in-picture window 380 of the pix 
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display 381 for viewing is illustrated. As described earUer, by depressing 
the left arrow button 148 on the remote control device 60, the PIP 
window 380 becomes highlighted. In the example of Figure 32, the pay- 
per-view channel shows a preview trailer for the motion picture '7effs 
World", which is now displayed in the center PIP window 375 and the 
perimeter PIP window 380 simult^eously. To select the pay-per-view 
movie, the select button 155 is depressed on the remote control device 60. 
It is contemplated that pressing a single, double or triple digit number on 
the numeric keypad 176 , followed by the ok button 178 of the remote 
control 60, will display the corresponding pay-per-yiew channel, along 
with the 12 nearest channels. It is also contemplated that this pix 
function can be used ivith audio-visual programs and services other than 

TV shows, in particular when the menu button 172 is used to display the 
output of the VCR 56, the CD 70, a hard disk or one of the other A/V 
devices 57 connected to the A/V transceiver 54. 



MPfi.1 Function 



Referring now to Figure 36, the menu function will now be 
described. The menu function permits users to switch the television 
^playtoanyA/VsQur€e^nnected^o4heJransceLvfir34^uA^^^ 
VCR 56, the CD ROM module 70, or one of the other A/V devices 57, and 
lets users control those A/V sources directly. As shown in Figure 36, 
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upon pressing the menu button 172 on the remote control device 60, the 
CPU 63 displays on the screen 180 a graphic overlay panel 420 which is 
superimposed over the currently viewed audio-visual program. As 
further shown in Figure 36, a plurality of audio-visual sovirces connected 
to the transceiver 54 are identified by representative icons. The currently 
viewed A/ V source icon is automatically highlighted, typically the TV 
icon 421. By depressing the right arrow button 150, or left arrow button 
148 on the remote control 60, other A/ V source icons may be highlighted 
and previewed. For example, by depressing the right arrow button 150, 
the next A/V somce icon, VCR 422, is highlighted, as shown in Figure 
36. Simultaneously, CPU 63 displays an audio-visual program derived 
from the highlighted source icon, in this case a videotape playing in the 
VCR 56 onto the screeri 180, as illustrated in Figure 36. To select and 
control any A/ V source whose icon is currently highlighted, in this case 
the VCR 56, the user can press the select button 155, whereafter the 
graphic overlay panel 420 disappears while the currently viewed 
program sourced from the VCR 56 is displayed in full screen. Thereafter, 
the user can press the play button 168 on the remote confrol device 60 to 
cause the CPU 63 to instruct the VCR 56 through the A/V connect 
module 66 or the IR control 82 to playback a previously recorded 
^rogram-on-theJVrR 5fi. Similarly, the.,us,e,r ean4?ress the stop. arrow , 
button 166, the rewind button 164, and/or the fast-forward button 170 on 
the remote control device 60 to hirther control the program soiurced 
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from VCR 56. It is contemplated that the CD RpM module 70 and some 
of the other A/V devices 57 induding ottier CPs; VCRs/laser d^^^ 
players, hard diste, telephones, answering machines, as well as 
transrnitting devices connected to voice maU, electronic maU and 
various on-line services can be similarly selected and controUed through 
the use of the menu function, as illustrated in Figure 36. 

o^hpr Functions 

Other hinctions may be realized with the present invention, 
induding numeric data entry. As shown in Figures 41 and 49,^^^^ 
pressing one or more buttons on the numeric keypad 176 of the remote 
control device 60, a user can confirm a finandal transaction by entering 
his or her personal identification number (PIN) in a confirmation 
display field 425. The numeric keypad 176 may also be used for dialing 
TV channel numbers, telephone numbers and other program source 
identifiers, as desired. 



Yet another hmction whidi may be optionaUy realized by 
the present invention is a talk function, whereby a user can depress tiie 



spoken commands into the microphone 179 located on the remote 
control device 60 in Ueu of or in addition to pressing buttons on the 
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remote control device 60. Through the use of voice recognition 
hardware and software operatiiig in conjunction with the CPU 63, the 
present invention can be made to interpret the spoken commands 
requested by the user, and invoke the corresponding functions. For 
example, a user may speak the word "sports" while pressing talk button 
181, which is eiqiiivalent to invoking the category function and 
highlighting the sports category, as if the user had pressed the 
corresponding sequence of buttons, as described earlier. It is further 
contemplated that the remote control device 60 in conjvmction with the 
TV 58 and a camera can be used as a video telephone for video 
conferencing and the like, wherein having engaged a telephone line (via 
the menu fimction) the viser speaks directly into the remote control 
device 60 as if it were a standard telephone. 



Pay-Per-Vie w Interface 

The present invention includes one possible pay-per-view 
(PPV) interface which will now be described. Assvime that the user has 



selected the TV source icon 421 using the menu function displayed in the 
graphic overlay panel 420, and further selects a pay-per-view program 

usin g either the list or the pix function. This s election results in a n ^ 

initial title screen to be displayed, as illustrated! in Figure 37, which may 
be static or animated. As shown in Figure 38, upon the selection of the 
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PPV program and subsequent to the display of the title screen of Figure 
37, a preview icon 382, a credit icon 384, an info icon 386, and a ticket icon 
388 are displayed, along with a preview trailer which is continuously 
looping and is displayed in a half-screen picture-in-picture window 390. 
It will be noted that in Figure 38, the preview icon 382 has been 
highUghted by default, thereby corresponding to the traUer being shown 
in the window 390. 

Referring now to Figure 39, by depressing the right arrow 
button 150 of the remote control device 60, the credit icon 384 may be 
highlighted. The credits for the pay-per-view movie are displayed on the 
screen 180 within the window 390. By depressing the right arrow button 
150 once again, the info icon 386 is highUghted. As shown in Figure 40, 
information related to the pay-per-view movie is then provided to the 
user, such as the title, the production company, a brief description of the 
movie, the rating and the total length. If the user desires to watch the 
pay-per-view movie, he/she depresses the right arrow button 150 once 
again to h ighUght the ticket ico n 388, as illustrated in Fig^ureJH^ 

As shown in Figure 41, upon the selection of the 

hicblichtff! ^^^ r the CPU 63 g enerates aMdisplayAPILM^ 

screen 180 a request for the user to input a "movie pass" password using 
the numeric keypad 176 of the remote control device 60. After entering 
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the personal identification number (PIN) using the numeric keypad 176, 
causing a confirmation sound to be played and confirmation symbols 
such as asterisks to fill in a blank confirmation display 425, the user 
depresses the ok button 178 or the select button 155 on the remote control 
device 60 to order and view the pay-per-view movie. As shown in 
Figure 42, transceiver 54 then displays the ordered program if it is 
available, or displays a message informing the viewer that the pay-per- 
view movie will begin screeiung within X number of minutes. In 
operation, depressing the ok button 178 or the select button 155 
subsequent to the entering of tiie movie pass personal identification 
number (PIN) results in the CPU 63 providing a signal to the cable 
service provider 50, over the T/T cable 52 using one of the back charmels 
102 (See Figure 3a). It will further be appreciated that during the waiting 
period prior to the transmission of the pay-per-view movie, additional 
trailers and other previews may be displayed to the user on the screen 
180. It will also be noted that if the user incorrectiy enters his/her movie 
pass PIN number, pressing the clear button 177 on the numeric keypad 
176 allows them to clear the confirmation display 425 and start over 
again. It will also be appreciated that other pay-per-view interfaces may 
be designed and implemented using the teachings of the present 
inv ention on general pvirppse audio-visual u s er interface. 
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HnmP Shopping Interface 

The present invention includes one possible home 
shopping interface, which wUl now be described. In Figure 43, a channel 
identified as "SHP" or "TV, Shop" represents a dedicated home shpppiitg 
service within the electronic spectrum illustrated in Figure 3a. It will be 
rioted that although in its present embodiment, TV Shop is presented as 
a television channel, it could also be presented as an on-line service 
through a transihitting device connected to the T/T cable 52. In the 
current embodiment, the selection of the TV Shop service results in a 
continuous full-motion video display of various paid-for commercials or 
advertising messages. As shown in the representative screen of Figure 
44, a TV Shop icon is displayed along with a blinking select icon (or right 
arrow icon) in a graphic overlay panel 400, at the start and end of each 
advertisement, prompting users to press the select button 155 (or right 
arrow 150). 

Referring now to Figure 45, by pressing the select button 155 



(or the right arrow button 150), the user can view additional information 
relating to the advertisements shown in the full motion video section of 
_^e^-5hop.^v*e^ample-x)f3gme^54twiUWotedifaat_a_U^^ 
the advertisers is provided, in which the advertisers whose commercial 
was playing last is highlighted. Through the use of the up arrow button 



Copied from 10354344 on 08/25/2005 



wo 95/01056 



PCTAJS94/06875 



. 68 

145 or the down arrow button 146, the ii ser may scroll t hrough th e 
advertisers, sequentially highlighting each of their advertising 
identifiers, along with a select icon 403 prompting a user to select that 
advertiser: Moreover, as shown in Figure 45, an "exit" icon 402, a 
"stores" icon 404, a "specials" icon 406, an info icon (or "compare" icon) 
408, an "order" icon 409 and other icons may be presented to the viewer. 
As illustrated in Figure 46 the selection of the "Attic at Casey's" 
advertiser with the select button 155 (or the right arrow button 150) 
results in a display of the various specials available from that advertiser. 
Ill Figure 46, there is shown cookware highlighted in conjimction vdth a 
still image of the cookware for sale. By depriessing the down arrow 
button 146 on remote control device 60, the highlighted section on the 
display can be moved down such that the mini-espresso (see Figure 47) is 
selected. Simultaneously with tiie highlightiiig of the mini-espresso 
selection, a still image of the mini-espresso machine for sale is shown. 

Referring to Figure 48, to obtain further information 
regarding the mini-espresso machine illustrated in Figure 47, the user 
depresses the select button 155 (or the right arrow button 150) on the 
remote control device 60 to highlight the info icon 408. As illusfarated in 

Figure 48, inforrpatinn relating to the particular product (i,e, espresso _ . 

machine) is shown on the screen 180. To order the mini-espresso 
machine illustrated in Figures 47 and 48, the user depresses the select 
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button 155 (or the right arrow button 150) to highlight the order icon 409. 
As Ulustrated in Figure 49, a personal identification order number 
window 420 is displayed in which the user (using the numeric keypad 
176) inputs a personal identification number (PIN). After entering the 
personal identification number (PIN), the ok button 178 or select button 
155 is depressed to order the product. > the presently preferred 
embodiment, once the personal identification number (PIN) of the user 
is entered into the system of the present invention and the ok button 178 
or the select button 155 is depressed, a signal is provided by ttie CPU 63 to 
tiie service provider 50, using one of tiie back channels 102 (See Figure 
3)a. As illushrated in Figure 50, a confirmation of the order, along with a 
deUvery time is displayed to tiie user. It wiU also be appreciated ti\at 
otiier home shopping interface variants may be designed and 
implemented using tfie teachings of the present invention. 

Summary 

The present invention as described provides metiiods an d 
apparatus for a unique audio-visual interface for television and other 
A/V programs and services. The present invention's hmctions and 
-^€atur^s^pJov4de-a^se4:4nteriace^ch^saisers^dan^^ 

programs of interest, access related information, contirol various audio- 
visual devices and order products or services firom their own homes. 
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While the present invention has been described with references to the 
various figvires , it will be appriedated that the figures are for illustratioh 
only, and do not limit the spirit and scope of the invention. For 
example, although the figvures have, by necessity, used example screens 
•having certain attributes, icoiw, criteria or functioivs, it will be 
appreciated that the invention is not limited by the specific examples 
provided. Rather, the present invention has application in any 
television and/or audio-visual display system. In addition, it will be 
noted that the present invention may be realized using a variety of 
computer hardware and computer software, and is not limited to any 
particular hardware or softwcire systems. 

Moreover, it will be appreciated that many of the functions 
and features of the present invention, such as graphic overlay panels, 
icons, and selection methods, are not static events and are perceived by 
the viser as having motion, color, soimd and/or animation. Specifically, 
it will be appreciated that the present audio-visual user interface also 
includes an audio interface using a plurality of soimd icons and 
backgrounds, which compliment the visual interface and are played 
almost every time a function of the present ihverition is used, and which 
can not be illustrated graphically here, but are p art of the present 
invention. Due to the limitations of a written specification, the reader is 
referred to a videotape entitled "EZTV;' submitted by the Applicants 
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based. 
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WF CLAIM: 

1. In an audio-visual (A/V) system comprising a visual display and 
an audio reproduction system, said A/V system further comprising a 
transceiver coupled to a pluraUty of A/V program and service offering 
sources and said display, and a control device coupled to said transceiver, 
a method for managing selection of a plurality of A/V program and 
service offerings provided by said A/V program and service offering 
sources, said method comprising the steps of: 

(a) receiving and storing offering information regarding said A/V 
program and service offerings from said A/V program and service 
offering sources; 

(b) displaying said received offering information on said display; 

(c) receiving customization control inputs from a user operating 
said A/V control device; 

(d) reducing said received offering inforination in response to said 
received customization control inputs, and redisplaying said reduced 
offering information on said"dispiay7~ ~^ ~r - - - 
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